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Abstract. 

The  sampling  theorem  states  essentially  that  if  the  frequency  spectrum, 
or  Fourier  transform,  g(u>)  of  a  time  function  f(t)  vanishes  for  cj  outside 
some  interval  I  ,  then  f(t)  is  completely  determined  by  its  values  at  cer¬ 
tain  discrete  sampling  points,  whose  density  is  proportional  to  the  length  of 
the  interval  I  .  This  note  gives  a  method  of  proof  of  the  sampling  theorem, 
both  for  the  case  where  the  interval  I  is  centered  at  the  origin  and  where 
it  is  not,  which  is  somewhat  simpler  than  the  previously  given  proofs,  and  at 
the  same  time  is  more  rigorous,  and  yields  several  useful  generalizations  to 
functions  of  several  variables  and  random  functions. 

1 .  Introduction. 

'.The  sampling  theorem,  as  first  stated  by  Shannon  [1],  asserts  essentially 
that  if  the  frequency  spectrum,  or  Fourier  transform,  g(w)  of  a  time  function 
f(t)  vanishes  for  ui  outside  some  interval  I  ,  then  f(t)  is  completely 
determined  by  its  valuer  certain  discrete  sampling  points,  whose  density  is 
proportional  to  the  length  of  the  interval.  The  usual  proof  of  the  sampling 
theorem  is  based  on  expanding  the  Fourier  transform  g(u)  in  a  Fourier  series. 
However,  it  appears  that  the  result  can  be  obtained  more  simply  by  expanding 
the  kernel  eiwt  in  a  Fourier  series,  as  a  function  of  w  in  I  ,  which 
amounts  to  proving  the  sampling  theorem  for  the  functions  of  t  given  by 
e1Wt  ,  with  uj  held  fixed  at  some  point  in  I  .  In  this  note,  we  use  this 
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method  to  prove  the  sampling  theorem.  We  also  show  how  the  method  may  he  used 
to  give  simple  proofs  of  various  extensions  of  the  sampling  theorem,  among 
them  those  due  to  Goldman  [2],  Kohlenberg  [3]*  and  Woodward  and  Davies  [4], 

The  theorems  we  prove  are  the  following. 

Theorem  ]!:  Suppose  that  the  function  f(t)  ,  defined  for  all  real  values 
of  t  ,  may  be  represented  as  a  Fourier  integral,  for  some  positive  constant  W  , 


(1.1) 


f(t) 


imt 

e 


g(ui)  dm 


where  the  function  g(m)  may  contain  5  function  terms,  but  not  at  m=  +  2nW  . 
Then,  for  every  t  , 

00 

u-2)  f(t;  -  y~  s(t  -  i) 

m=-oo 


where 


(1-3) 


imt 

o 


dm 


(1.4) 


sin  2nWt 
2jtWt 


Theorem  II:  Suppose  that  f  ( t., ,  .  .  . , t„)  ,  defined  as  a  function  of  K 
-  -  _L  K 

variables,  may  be  represented  as  a  Fourier  integral,  for  positive  W  , . . . ,W  . 

x*  is. 
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P 2nW,  f2, tW„  I(«1t1  +  ...4tt vt  ) 

(1.5)  f(t  ,  ...,t  )  =  /  ...  /  do)  .  ..doj  e  g(u  ) 

1  K  J-2jtWj  J-2nWK  1  K  1  K 


where  g(co  ,  .  ..,w  )  may  contain  5  function  terms,  but' not  at  the  2  points 
X  K 

of  the  form  (+  2«W  ,...,+  2nW  )  .  Then 
—  X  —  K 


(1.6)  f(t1,...,tK)  = 


m 

f(2W?' 


nij  y  •  •  • }  -co  1 


m>  2VT-1  s  ■  ti”2vr^  ’  • s  ^ 

K  K  K 


Theorem  III :  Let  f(t)  be  a  stationary  random  function  (as  defined  by 
Doob  [5])  whose  covariance  (or  autocorrelation)  function  R(t)  =  Ef(t)  f(t-rx) 
may  be  written, 


where  G(w)  is  the  power  spectrum  cf  the  function,  which  may  contain  5 
function  terms,  but  not  at  u  =  +  2jtW  .  Then 

00 _ 

U.8)  f(t)  =  y  f(i)  s(t .  i) 

m=-co 

where  the  infinite  series  in  (l8)  converges  stochastically  (in  the  sense  of 
convergence  in  mean  square). 

Theorem  IV:  Suppose  that  f(t)  may  be  represented  as  a  Fourier  integral, 
for  positive  W  and  W  , 
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(1.9)  f(t)  = 


r2n(W  +  W)  .  , 

/  O  lUlt  /  v 

/  e  g(u)  + 

j2^o 


’-2jtW 


-2jt(W  +  W) 

O 


e'"'11"'  g(u>)  du 


where  the  function  g(to)  may  possess  S  function  terms,  but  not  at 

\ 

u)  --  2«W  or  u  =  +  2jt(W  +  W)  or  ui  =  -t  2it(rW  -  W  )  where  r  is  the 

—  o  —  o  —  o 

integer  such  that 


(1.10) 


w  w 

2lT<r<2T+1 


Let 


(1.11) 


'2jt(rW  +  W  ) 

s(t)  =  I  0  duj[cos  ut  +  sin  ut  cot  xrWk] 

2nW 

o 


2rtW 


n2n(Wo+  W) 
'2*(rW-W  ) 


dw[cos  u)t  +  sin  wt  cot  rt(r  +  l)Wk] 


where  k  is  a  constant  satisfying  the  condition  that  rWk  and  (r  +  l)Wk 
are  not  equal  tc  any  of  the  integers  0,  +  1, . . .  Then,  for  every  t  , 


00 


(1.12) 


f(t)  = 


m=-co 


f(|)  8(t  -  g) 


+  f(S  +  k)  s( 


t) 


If  Wq/W  is  an  integer,  then  with  k  =  l/2W  ,  (1.12)  reduces  to  (1.4). 

It  will  be  clear  from- what  follows  that  Theorems  II  and  III  can  be 
extended  in  the  same  way  that  Theorem  I  is  extended  by  Theorem  IV. 


2.  Proofs  of  Theorems  I- III. 

We  start  with  the  following  basic  fact  from  the  theory  of  Fourier 
series.  For  any  real  number  t  ,  and  u>  such  that  |uj  |  <  2jtW  , 
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(2.1) 


s(t  -  §) 


The  infinite  series  in  (2.1)  converges  in  general  for  |  to  (  <  2jrW  ,  but  not 

\. 

for  cj  =  +  2jtW  .  However,  the  consecutive  sums 


.  m 

iU  2W  (  + 
e  s(t 


m!  <  M 


are,  for  fixed  t  ,  uniformly  bounded  for  |u>|  <  2jtW  ;  that  is,  there  is  a 
constant  K  such  that  |SM(u,t)  |<  K  for  M  =  0,1,2,  ...  and  jw |  <  2jtW  . 
A  not  quite  vigorous  way  of  verifying  (2.1)  is  as  follows.  The  right 


hand  side  of  (2.1)  may  be  written 


(2.2) 


It  may  be  verified  that 


m=-co 


(2.3) 


inti  o 
e  =  2n 


6  (a  +  2jtn) 


and,  for  any  function  f(x)  , 


J  f(x)  B(~~)  dx  = 


if  the  point  a  lies  in  the  interval  of  integration  I  ;  otherwise  the 
integral  in  (2.4)  is  zero.  Now,  for  |  u>  |  <  2nW  ,  the  only  value  of  n  such 
that  loo  +  4nnW j  <  2nW  is  n  =  0  .  Consequently,  in  view  of  (2.3)  and  (2.4), 
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it  is  seen  that  the  value  of  (2.2)  is  elaJt,  for  |gj|<  2j;W  ,  which  verifies 

(2.1). 

Next,  to  prove  Theorems  I  and  II,  merely  replace  e"5"^  in  (l.l)  and 
(l.5)  hy  the  infinite  series  of  (2.1);  that  the  order  of  integration  and  summa¬ 
tion  may  be  interchanged  follows  rigorously  by  the  theory  of  Lebesgue  integra¬ 
tion. 

Next,  to  prove  Theorem  III,  we  first  note  the  fact  that,  from  (1.7)  it 
follows  that  f(t)  may  be  represented  as  a  stochastic  integral  as  follows: 


(2.6) 


f(t) 


P2  itW  .  , 

j  elw  dZ(m) 

J- 2jtW 


By  the  theory  of  stochastic  integrals,  (1.8)  follows  from  (2.6)  if  one  shows 
that 


lim 
M  -»  00 


iwt 

e 


M 


^u!,t) 


2 

G(uj)  dw  =  0 


which  follows  from  the  facts  stated  at  the  beginning  of  this  section. 


3.  Proof  of  Theorem  IV. 

To  prove  (1.12)  we  begin  by  conjecturing  that  for  uj  such  that 
2itWQ  <  | to |  <  2jr(WQ+  w)  ,  e1^  may  be  written  in  the  form 


00 


(3-D 


i'jjt 


-z 


m 

iU)  - 

W  /  m, 
e  Sl(t  "  + 


00 


1U)(vf  +  k) 


m=-co 


for  some  constant  k  ,  and  functions  s^(t)  and  s^ ( t )  which  are  of  the 


-7- 


form,  for  i  =1,2, 


(3-2) 


si(t) 


S^Cco)  dco 


where  the  region  of  integration  I  consists  of  the  intervals  (2jtWQ,2jt(Wo+  W)) 
and  (-2jt(W  +  W),  -2jtWQ)  .  In  view  of  (3-2),  the  right  hand  side  of  (3.1) 
may  be  written 


(3.3) 


dX  S  (x)  e 


iXt  V 


m 


f  jvc  M  iXt  ik(to-X)  S~  i^U> 
+  /  dXS  (X)  e  e  '  '  e 

Jl  ID 


We  next  evaluate  (3-3)  by  means  of  (2.3)  and  (2.4). 

It  is  readixy  verified  that,  for  u >  in  I,  w  +  2jtnW  lies  in  I  only  for 
n  =  0  ,  and  for  one  other  value  of  n  ,  which  we  denote  by  N(co)  ,  whose 
values  are  given  in  Table  A  in  terms  of  the  integer  r  given  by  (1.10). 

Table  A 


For  co  in  the  interval 


N(co)  = 


ti)  +  2jtN(u)W  lies  in  the 
interval 


J,  :  2«W  <  co  <  2jt(rW-W  ) 

1  0  o 

-J,  :-2n(rW-W  )  <  co  <  -2nW 
1  o  o 

J  :  2*(rW-W  )  <  u  <  2jt(WQ+  W) 

j-J  :-2jt(W  +  W)  <  co  <  -2jt(rW-W  )| 


-r 


- ( r+1 ) 


-J, 


-J, 


r+1 
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Then,  for  oj  in  I,  the  value  of  (3.3)  is  given  by  - 

(3.M  2]tW  e1"*  [^(u)  +  S_>)]  +  2jtW  eit("  +  2,tl,WW> 

[S1(ui  +  2jtli(w)W)  +  e-l2«N(u)Wtg^u  +  2»N(u)W)J 

Now,  let  S^(oo)  and  Sg(ui)  be  defined  so  that  they  vanish  for  u 
outside  I,  and  for  oj  =  +  2jt(rW_Wo)  ,  and  for  other  values  of  u  in  I 
satisfy  the  relations 

(3-5)  2nW  S1(u)  =  1  -  2nW  S2(w),  2*W  S2(w)  =  [l-e12*11^^]-1 

where  we  now  choose  k  so  that  rWk  and  (r+l)Wk  are  not  equal  to  any 
of  the  integers  0,  +  1,  +  2,  . . .  .  In  view  of  Table  A  it  may  be  verified 
that  the  following  relations  hold  for  co  in  I,  where  an  asterisk  denotes 
a  complex  conjugate : 


N(w)  =  -  N(-u),  S1(u)  =  S 2(-u) 
S2(w  +  2nN(w)W)  =  S*(w)  =  S2(-u), 


S  (u  +  2nN(u>)W)  =  S*(w)  =  S  (-u), 

S1(uj  +  2nN(u)W)  +  e-l2rtN(u>)Wk  +  2nN(uj)W) 


=  [S1(uj)  +  e 


i2jtN(u>)Wk 


S2(u)]*  =  0 


2jtW(S  (w)  +  S2(u))  =  1 
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■j  j  i|4- 

In  view  of  these  relations,  the  value  of  (3.4)  is  e  °  -for  w  in 
I,  except  perhaps  for  co  =  +  2n(rW-W  )  ,  and  (3-1)  holds  with  s^(t)  and 
Sg(t)  given  by  (3-2)  and  S-^co)  and  S^w)  given  by"  (3-5)- 

We  now  write  (3*1)  in  a  more  convenient  form.  Since  S^(u>)  =  Sg(-ci)) 
it  follows  that  s^(t)  =  Sg(-t)  .  Define  s(t)  =  s1 (t)  .  Then,  since 
S*(u)  =  S1(-u)  , 

f  ■  +  f  2it(W  +  W) 

(3-6)  s(t)  =  /  e1U)  S.  (co)  du)  =  2  /  °  Real  [elurtS,  (co)  ]  dio 

ui  J+2iMo  1 

Now 

(3-7)  2  Real  [elu,t  S1(u>)]  =  ^ 


cos  cot  +  sin  cot  cot  jtN(co)Wk 

Thus  (1.12)  has  been  established  for  the  complex  exponentials  eltJt  for 
27tWQ  <  |  co  |  <  2jr(WQ+  W)  ,  with  the  possible  exception  of  co  =  +  2n(rW-W  )  . 
To  establish  (1.12)  for  any  function  f(t)  satisfying  (1.9),  merely  re¬ 
place  e10^  in  (1.9)  by  the  infinite  series  representing  it. 


1 

"  2jtW 


cos  uit  -  cos  (ut  +  2rtN(u>)Wk) 
1  -  cos  2itN(u))Wk 
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"A  SUPPLE  PROOF  AND  SO?IE  EXTENSIONS 


OF  THE  SAMPLING  THEOREM"!7 


Emanuel  Parzen 


This  report  was  written  in  terminology  vfoich  would  presumably  be 
most  readable  to  communication  engineers.  For  the  reader  interested 
in  mathematical  precision,  the  following  restatements  of  hypotheses 
should  be  noted. 

In  Theorem  I,  for  ('Ll)  read 


p2  tL.T  . 

f(t)  -  /  d\\'~) 

-2  -ttT, 


■where  V(w)  is  a  function  of  bounded  variation  continuous  at  w  s  ±2 -mb'. 
Ln  Theorem  II,  for  (1.?)  read 


i.l.b)  f  (t^,  ••  • .  ,t.^) 


■2ir7rK  i(*JiV,*,4‘1ctK) 

-2rr;;., 


dV(^1,...,,,.) 


•where  Y(  , . .  . ,  ^,r)  is  a  function  of  bounded  variation  which  assigns 
measure  zero  to  the  set  [  (  . . . ,  ,n,)  :  =  ±2  mVL  for  some  i  j  . 

In  Theorem  III,  for  (1.7)  read 


(1.7) 


/?2w  7/  . 

R(  T  )  =  /  e1&H  dF(-) 

—2  it  W 
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where  the  spectral  distribution  function  F(*>  )  is  monotone  non-decreasing 
and  continuous  at  ^  =  ±2 n\'!. 

In  Theorem  IV,  for  (1.9)  read 

p2-rr  (W  ♦  h'f)  .  ,  p-2-TT'il 

{1.9)  f(t)  =  /  0  eliJt  d V(to)  ♦  /  0  e:'“)tdV(^) 

7  2  rrV;Q  </-2  ir(w*\7) 

where  V(w  )  is  a  function  of  bounded  variation  continuous  at 
w  =  ±2 -?rWo,  =  +2-TT  (Wq-*-V0,  and  ^  =  ±2w  (rVf  -  W  ),  v/here  r 
by  (1.10). 


is 


